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Abstract 

We consider the asymptotic normality in L 2 of kernel estimators of the long run covari¬ 
ance of stationary functional time series. Our results are established assuming a weakly 
dependent Bernoulli shift structure for the underlying observations, which contains most 
stationary functional time series models, under mild conditions. As a corollary, we 
obtain joint asymptotics for functional principal components computed from empirical 
long run covariance operators, showing that they have the favorable property of being 
asymptotically independent. 
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1. Introduction 

In multivariate time series analysis, the matrix valued spectral density and the long run 
covariance matrix, which is 2n times the spectral density evaluated at frequency zero, are 
fundamental in a multitude of applications. For example, the long run covariance matrix 
must be estimated in most inference problems related to the mean of stationary finite 
dimensional time series, see e.g. Hannan (1970), Xiao and Wu (2012), Politis (2011), and 
Aue et al (2009). Additionally, dynamic principal component analysis utilizes estimates 
of the long run covariance matrix as well as the spectral density to perform meaningful 
dimension reduction for time series data, see Brillinger (2001). 

Multivariate techniques are difficult to apply, however, when the data is obtained by 
observing a continuous time phenomena at a high resolution or at irregularly spaced time 
points. A flexible alternative for studying such records is to break them at natural points, 
for example into daily or monthly segments, in order to form a series of curves. The 
field of functional time series analysis has grown considerably in recent years to provide 
methodology for such data; the main difference from traditional functional data analysis 
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being that it accommodates for possible serial dependence. The long run covariance 
kernel, which is an analog of the long run covariance matrix, also plays a crucial role in 
this setting. We refer to Ferraty and Vieu (2006) for a review of methods in functional 
data analysis and Hormann and Kokoszka (2012) for a survey on functional time series 
analysis. 

In order to formally define the objects introduced above, let {W i (t)}“_ 00 , t e [0,1], be 
a stationary functional time series. The bivariate function 

OO 

C(t,s)= Y 7 t(t,s), where = cov(X 0 (t),X e (s)), 

l=—oo 

is called the long run covariance kernel, and is a well defined element of L 2 ([0, l] 2 , M), 
assuming mild weak dependence conditions. C(t,s ) arises primarily as the asymptotic 
covariance of the sample mean function. Via right integration, C(t, s ) also defines a pos¬ 
itive definite operator on L 2 ([0,1],M) whose eigenvalues and eigenfunctions, or principal 
components, are the focus of a number of dimension reduction and inference techniques 
with dependent functional data. Due to its representation as a bi infinite sum, C(t,s ) 
is naturally estimated with a kernel lag-window estimator of the form 


C N (t,s) 


oo / ■ \ 

K (j-J 

= — nn ' ' 


( 1 . 1 ) 


where 


7 i{t,s) = 


k E(V(«) - X N (t))(X Ht ( s ) - X N (t)), 

3 = 1 

1 N 

x E kw - x N mx j+i (s) - x N (t)), 

j=l-i 


i > 0 


i < 0. 


We use the standard convention that ji(t, s) = 0 when i > N. 

The estimator in (11,1ft was introduced in Horvath et. al (2013), where it is shown to 
be consistent under mild conditions, and its applications are developed in Horvath et 
al (2014) and Jirak (2013) in the context of inference for the mean and stationarity 
testing with functional time series. Hormann et al (2013) develops an analog of dynamic 
principal component analysis based on the spectral density operator of functional time 
series, which is directly related to the long run covariance operator. 

It is a classical result that kernel lag-window estimators of the spectral density of univari¬ 
ate and multivariate time series are, when suitably standardized, asymptotically normal, 
see Rosenblatt (1991). The definition of the spectral density operator of a stationary 
functional time series and its asymptotic normality were first established in the work of 
Panaretos and Tavakoli (2013). In order to obtain their results, functional analogs of 
classical cummulant summability and mixing conditions are assumed. As noted in Shao 
and Wu (2007), cummulant conditions are exceedingly difficult to check, even with scalar 
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time series, and mixing conditions, although classically popular, exhibit some unattrac¬ 
tive pathologies. For example, the autoregressive one processes with independent and 
identically distributed errors that take the value 1 and -1 with equal probabilities are not 
mixing. On top of this, in several theaters of application non linear time series models 
are of interest, and in this case it is unknown whether such conditions are satisfied in 
the infinite dimensional setting. 

In this paper we establish the asymptotic normality of Cisr(t,s ) in L 2 ([0,1] 2 ,M) for a 
broad class of stationary functional time series processes. In particular, we consider 
the case of L 2 ([0,1],M) valued random functions exhibiting an L p — m approximate 
Bernoulli shift structure, which extends the results of Shao and Wu (2007) and Liu and 
Wu (2010) to the infinite dimensional setting. Doing so greatly generalizes the class 
of functional time series processes for which a normal approximation for Cm can be 
achieved. An immediate corollary of this result is the limit distribution of the empirical 
eigenvalues and eigenfunctions computed from Cm, which play a fundamental role in 
principal component analysis with dependent data. 

The rest of the paper is organized as follows. In Section [2] we state our assumptions and 
the main result of the paper. The section concludes with an application of our results 
to determining the optimal bandwidth parameter. Section [3] contains the application to 
the limit distribution of the empirical eigenvalues and eigenfunctions computed from Cm- 
The proofs of the main results of the paper are contained in Section [4l which is broken 
into several subsections that each illuminate the main techniques behind the proof. 

2. Assumptions and main results 

Let || • || denote the L 2 norm of square integrable functions on [0, l] rf , the dimension 
d > 1 being clear by the input function, and let J to mean f Q . Throughout this paper 
we assume that 

X = {X i }°l_ OQ forms a sequence of Bernoulli shifts, i.e. Xj = g(ej, £j -\,...) (2.1) 

for some measurable function g : S°° i —> L 2 and iicl random variables e v 
— oo < j < oo, with values in a measurable space S, 


€j(t) — €j(t,ui) is jointly measurable in —oo < j < oo (2.2) 


£ , || Xo || 4+ ' 5 < oo for some 5 > 0, 


(2.3) 


and 


{Anj^-oo can be approximated by the m-dependent sequences (2.4) 

X n ,m — gi^nt ^n— 1 ) •••> ^n—m.+li ^ n ,m) with £ n m ( • •), 

where the e* fc ’s are independent copies of e 0 , independent of 
{ej, —oo < i < oo}, such that 


n,m 


n =—oo 



3 


y> y>J < oo with c m = (. E\\X 0 - X 0 , m \\Y\ 

k =1 \m=k / 

where w(t) > 0 is regularly varying at zero, and w(t)/t 1 ^ 3 —> 0 
as t —* 0. 

Nearly all stationary time series models based on independent innovations satisfy condi¬ 
tion (12. ip . including linear processes in function spaces, and the functional ARCH and 
GARCH processes, see Bosq (2000) and Hormann et al (2013). Condition (|2.4j) specifies 
the level of dependence that is allowed within the sequence in terms of how well it can be 
approximated in the L 2 sense by finite dependent processes, and thus defines a version 
of L p -m~approximability for functional time series, see Hormann and Kokoszka (2010). 
Condition (I2.4[) is satisfied when, for example, c m = 0(m~ a ) for some a > 4. In compar¬ 
ison, Shao and Wu (2007) assume a geometric rate of decay for similar approximation 
coefficients with scalar time series. It follows from (I2.1jl — (12.4p that C(t,s) is an element 
of L 2 {[ 0, l] 2 , M) (cf. Appendix A.2 in Horvath et al (2013)). 

We assume that the kernel K in the definition of CV satisfies the following standard 
conditions: 

K(0) = 1, (2.5) 

K is symmetric around 0, K{u ) = 0 if u > c with some c > 0, (2.6) 

and 

K is Lipschitz continuous on {—c. c]. where c is given in (j2.6[) . (2.7) 

Lastly we take the window (or smoothing parameter) h to satisfy that 

h = h(N) —> oo and _■* 0; as N ^ oo. (2.8) 

The main result of our paper establishes the asymptotic limit distribution of 

Z N {t, s ) = C N (t, s ) - EC N (t , s). 

Theorem 2.1. If (I2.ip ~ 02.8p and 


h/N 5/ ^ +2S) 0 (2.9) 

hold, where S is defined by (12.31) . then one can define a sequence of Gaussian pro¬ 
cesses T ]\j(t, s) defined on the same probability space, and satisfying ET^ft, s) = 0, 
AT N (t, s)T]\r(t', s') = L(t , s, t', s') with 

Lift, s , t', s') = [C(t, s)C(t', s') + C(t , t')C{s, s')] J K 2 (z)dz (2.10) 

such that 

\\(N/h) 1/2 Z N - Tjv|| -4 0, as N ^ oo. (2.11) 
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Theorem 12.11 provides a Skorokhod-Dudley-Wichura representation of the weak con¬ 
vergence of Zn to a Gaussian process. We note that the distribution of the limiting 
Gaussian process T N does not depend on N, and hence the approximation (12. lip can be 
readily used to compute the limiting behavior of functionals of Zjy. 

Assuming a higher moment condition than H2.31) . a more optimal result can be proven 
in the sense that we can relax (12.9p in Theorem 12.11 

Theorem 2.2. If (I2.ip — (j2.8[) and 

£||X 0 || 8 < oo (2.12) 

are satisfied, then (12. lip holds. 


Remark 2.1. Panaretos and Tavakoli (2013) and Hormann et al (2013) consider the 
estimation and, in the case of Panaretos and Tavakoli (2013), the asymptotic theory of 
more general objects that they refer to as the spectral density kernels; they are defined 
by 

fw(t, s) = — exp(-iuj)'y j (t, s ), u G [0, 2vr), 

jez 

where i is the imaginary unit. For a fixed oj, f w is estimated analogously to the long run 
covariance kernel by 


L(f,s) 


7T- K ( { ) ex P(-^f)l'j(t, s ). 


In this paper we only consider the asymptotics of 27 t f 0 (t,s), but we could extend our 
results to the case of the joint asymptotics of / w over c o as in Panaretos and Tavakoli 
(2013). This would require working with the fourier transform component of the def¬ 
inition and follows along the lines of the univariate case as demonstrated in Brillinger 
(2001). The difficult and novel part of this theory is in establishing a Gaussian approxi¬ 
mation for the function space component of the spectral density, and this is captured by 
the long run covariance kernel. 


2.1. Bias, bandwidth selection, and positive definiteness 

In order to infer from this the limit behavior of Cn — C, we must also consider the bias. 
Following Parzen (1957), we assume that 


K(x) — 1 

there exists a q > 0 such that 0 < lim ——- = < oo, 

a;—>0 \X P 


and 


there exists a q' > q such that \I\ l 

t= — OO 

The asymptotic bias is given by /r _q 5'(t, s), where 

OO 


< oo. 


(2.13) 


(2.14) 
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Theorem 2.3. If (12.131) . (12.141) hold and h q /N —> 0, then we have 


EC n -C- lr q 3 


o(h~ q ). 


We note that if the unbiased estimators Nj^ N (t, s)/(N — i) are used in the definition of 
Cjv, then Theorem 12.31 remains true without assuming h q /N —y 0. 


The minimization of the asymptotic mean squared error provides a popular choice for 
h in case of univariate data (cf. Parzen (1957) and Andrews (1991)). In our case the 
“optimal” h minimizes E\\Cn — C || 2 . Our results show that 

E\\C n - Oil 2 « ^A||T 1 || 2 + h~ 2q m 2 . (2.15) 


Since 


A||Ti|| 2 = 2 


C(t,s)dtds'j J K 2 (u)du, 


we get that the minimum of the asymptotic value of the mean squared error in (12.151) is 
reached at 

h opt « c 0 Al 1/(1+2c|) , 


where 


o = (qllSIl 2 ) 


2\ l/(l+2q) 


—l/(l+2q) 


C(t,s)dtds ) / K 2 (u)du 


The constant Co is a complicated function of the unknown correlations 7 i(t, s ) and the 
long run covariance function C(t, s ). Replacing the unknown functions 7 e(t, s ) and C(t, s ) 
with their empirical counterparts, we get a plug in estimate for c 0 . A data driven 
estimator is discussed in Horvath et al (2014) for the “flat top” kernel, i.e. when q = 00 . 
According to (12.15jl and since h tends to infinity with N, the asymptotic integrated 
mean squared error is minimized by using a kernel K for which q may be taken to be 
as large as possible. This encourages the use of a kernel function that is smooth or 
“flat” near the origin, but for arbitrary kernels C need not be positive definite. Several 
methods have been proposed to address related issues in the finite dimensional setting, 
see Politis (2011); they typically involve either sacrificing possible improvements in the 
bias by using a kernel that makes the estimator positive definite from the outset, like 
the Bartlett kernel, or using a higher order kernel and then altering the estimator to be 
positive definite by removing the negative eigenvalues from the diagonalization of the 
operator. These methods could be adapted to the functional setting, and the authors 
plan on studying such techniques in future work. 


3. Application to the limit distribution of functional principal components 

A technique to reduce the dimension of functional data that has received considerable 
attention, both in applications and theoretical investigations, is principal component 
analysis (PCA); we refer to Ramsey and Silverman (2005) and Horvath and Kokoszka 
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(2012) for reviews of the subject. Typically the principal components used are computed 
as the eigenfunctions of the sample covariance function 

1 N 

Ch(t,s) = - £(Xi(f) - X^mXiis) - X >(»)). 

i= 1 

Due to their important role in PCA, the difference between the empirical and theoretical 
eigenvalues and eigenfunctions have been investigated by several authors. Kokoszka and 
Horvath (2012, pp. 31-35) contains inequalities for the accuracy of the replacement of 
the theoretical PCA’s with their empirical counterparts. The asymptotic normality of 
the deviation between the empirical and theoretical eigenvalues and eigenfunctions was 
proven by Dauxois et al (1982), Bosq (2000) and Hall and Hosseini-Nasab (2007) assum¬ 
ing that the AYs are independent and identically distributed. In great generality, Mas 
and Menneteau (2003) show that the asymptotic properties of the empirical eigenvalues 
and eigenfunctions are automatically inherited from the asymptotic properties of their 
corresponding operators. Kokoszka and Reimherr (2012) investigated the asymptotic 
properties of the eigenvalues and eigenfunctions of C S N when the observations are from 
a stationary functional time series. 

In case of inference with dependent functional data it may be preferable to use the 
theoretical principal components defined by the the long run covariance operator, 


A iVi(t) — I C(t,s)vi(s)ds, 1 < i < oo, (3.1) 

where we have used Ai > A 2 > • • • > 0 to denote the ordered eigenvalues. These define 
an example of dynamic functional principal components as defined in Hormann et al 
(2014). The theoretical eigenvalues and eigenfunctions defined in (13. ip can be estimated 
from a sample by the eigenvalues and eigenfunctions of the empirical long run covariance 
function 


A iVi(t) = / Cjv(t, s)vi(s)ds, l<i<N. 


(3.2) 


It was shown in Horvath et al (2012) that if for some p > 1, 

Ai > A 2 > • • • > A p > Ap + i > 0, (3-3) 

then the estimators defined in (|3.2[) are asymptotically consistent in the sense that 
max |Aj — A*| = 0p(l), and max pjA — Uj|| = op(l), as N —> 00 , 

l<i<p 

where s* = sign((A,U;)). We show that Theorems 12. HYOl imply the limit distributions 
of (N/h) 1 / 2 (X i - A i), (N/h)^ 2 (vi(t) - v { (t )) and (N/h) l / 2 \\vi - Vi\\, 1 < i < p. 
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Theorem 3.1. 

linijv—>oo N/ h 1+2q 
l < p such that 


Under the conditions of Theorems \2.1\ and \2.tA (j3.3[) and assuming 
= a, there exist random variables Qe,N and random functions Ge,N(t), 1 < 

max | ( N/h) 1/ 2 (X e - X e ) - $e, N \ = o P (l), 


and 


max 

1 <£<p 


| (N/h) 1/2 (s e v e - v t ) 



°p( 1) 


Ge,N(t), 1 < l < p} 


1/2 


= <( ( 2 I K 2 (z)dzj Mtx + a J j $(u, s)vg(s)ve(u)duds, 

^XdX ' 2 V v,(tX lXk)1/2 

Xe — Xi 


’ —c 


K 2 (z)dz ) £ v k {t)^L-AT t 

l<k^£<oo 

v k (t) 


Lk 


* E 

l<fc^<oo 


Xe — Xi 


$(u, s)ve(u)ve(s)duds , 1 < t < p >, 


where J\fe t k are independent standard normal random variables. 

If a = 0, then Theorem 13.11 implies that the empirical eigenvalues and eigenfunc¬ 
tions are asymptotically consistent with rate ( h/N )E 2 . Theorem 13.11 also shows that 
(N/hy/ 2 Cx e — Xe) are asymptotically independent and normally distributed, and that, 
on top of being orthogonal functions, (N /h) 1 ^ 2 {seVk ~ v k ) l < k < p are stochastically 
independent and Gaussian. This result is along the lines of the asymptotic independence 
and normality of the suitably normed and centered empirical eigenvalues and eigenfunc¬ 
tions of the empirical covariance function of independent and identically distributed 
functional observations. The main difference is the norming; we use ( N/h )E 2 in the case 
of the kernel estimator for the long run covariance function instead of the IV 1 / 2 rate in the 
case of the sample covariance. Since (N/hY^WseVe — U£|| 2 , 1 < f < p are asymptotically 
independent, assuming that a = 0, Theorem 13.11 yields 


N 

~h 


\seve - ve\ 


2 


V 
—>■ 



(A* 




This is the analogue of the result of Dauxois et al (1982) to the functional time series 
case. 


4. Proofs of Theorems I2.1H3.1I 

The proofs of the main results of the paper, Theorems 12.11 and Theorems 12.21 are carried 
out in three primary steps. Firstly, we show that the process Z^ can be well approx¬ 
imated by an analogous process Z N)Tn that is constructed using m-dependent random 
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functions with the aid of (12. 4 p in Subsection 14.11 Once we have achieved this approxima¬ 
tion, we obtain a lower dimensional approximation Z ^ m based on d dimensional random 
functions via a projection technique in Subsection 14.21 It is then straightforward to cre¬ 
ate a gaussian approximation for this process (Subsection 14.3p . and we may then retrace 
our steps with the gaussian process by letting d and m tend to infinity (Subsection 14.41) . 
We then obtain as a simple corollary the asymptotic distributions of the eigenvalues and 
eigenfunctions in Subsection 14.51 


4-1. Approximation with m-dependent sequences 

To simplify notation, we assume throughout the proofs that c = 1 in (12.6p and (12 . 71) . 
First we show that replacing the sample mean X N (t) with EX 0 (t ) in the definition of % 
does not effect the limit distribution of Z^. It is clear that we can assume without loss 
of generality that 

EXi(t) = 0. (4.1) 

Let 


where 


C N (t, s) 


£ K 



7 i(t,s), 


7 i(t,s) = %N(t,s) 


1 N-i 

JfJ2 X ^ X i+ i ( s ^ i ~° 

3 = 1 
1 N 

— Xj(t)Xj +i (s), i < 0. 

j=l-i 


(4.2) 


We prove in the following lemma that Z N and Zn have the same limit distribution, 
where Z N (t , s ) = C N (t, s ) — EC N (t, s ). 

Lemma 4.1. If (I2.ip ~ 02.8p are satisfied, then we have that 

-j^\\Zn ~ Zn\\ 2 = op{l). (4.3) 

Proof. It is easy to see that 


I Zn ~ Z N | 
< \\X N \\ 

+ \\X 


(4.4) 


oo / ' \ 1 i 

i =0 v ' j =1 


+ 


N 




hj N 

i=0 x / j=i-\-l 


N 


0 / • \ i N 

Ex rH£^' 


hj N "3 

3 =!-* 


+ 


0 / . \ i N-\-i 

£ k (t)jjY, x 


hj N 

j =i 


9 
































+ 11*. 


AM 


E K 


Berkes et al (2013) showed that under fl2.lh - fl2.4h 

||*iv|| = Op(N~ 1 ^ 2 ), 

and therefore by (12.61) and fj2.7[) 


(4.5) 


17 


AM 


E K (*/*) 


i ——oo 


= 0 P (h/N). 


On account of EX 0 (t)X iti (s) = 0, by (j2,4|) we have that 


E 

i=1 


EX 0 ( t)Xi ( s)dtds 


< 


OO 

(£||Xo|| 2 ) 1/2 ^(£||X 0 - X 0 ,|| 2 ) 1/2 < oo, (4.6) 


2—1 


and therefore we obtain immediately that 


oo 1 N—i 

E^wn^Et 

3 =1 


i=0 


AT-i AT-£ 


OO iV — l —t r, r, 

N~ 2 K ii/h) K {i/h) EE// EXj(t)X k (s)dtd 

i,i=0 j= 1 k =1 ^ ^ 


J=1 k=1 

OO 

= 0(1/1V) ^ I AT (i//i) AT (£//i) I 

i/=0 

= 0 P (h 2 /N), 

where we used again (12. 6 p and (12.71) . Thus we get by (14. 5 p that 

N-i 

= 0 P (h/N). 


II* 




E a '( ! /m=E a 'j 

i=0 j=1 


Similar arguments provide the same upper bounds for the other terms in (|4.4[) which 
implies that (N/h) l ^ 2 \\Z N — Z N \\ = Op^ih/N) 1 ^ 2 ) = op(l) which gives (14.31) . □ 

We recall X n>m , 1 < n < N defined in (12 . 41) for m > 0. Replacing X, with Xi jTn in the 
definition of Cat we define 

C N ,m(t,s ) = jr K (^\ 7! m) (t,s), 


where 


#W) = < 


N-i 


y Xj t m(t)Xj + i t . 


i > 0 


3 = 1 
N 


N 




jasl—j 


and 


CjV,m(^) 5) EC Njm (t, S). 
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Lemma 4.2. If (12.11) (12.81) are satisfied, then we have 


lim || C m - C\\ = 0 


(4.7) 


where 


Also, as m —> oo, 


C m (t, s) — 22 EX 0> m(t)Xi, m (s). 


£——m 


J C m (t,t)dt — > J C(t,t)dt, (4.8) 

OO \ / oo \ 

EX 0 (t)Xt im (s) J2 EX o, m (t)Xt(s) dtds lie'll 2 , (4.9) 


\£ = —oo 


\ 3 =~ oo 


and 


Y EX 0 (t)X em (t)dt -f C(t,t)dt , 


(4.10) 


£——oo 

Proof. By definition we have 

—m —1 


C(t,s)= 22 EX 0 (t)Xfis)+ 22 EX 0 (t)X e (s)+ 22 EX 0 (t)X t (s). 

£=—oo £=m -\-1 £=—m 

Due to the fact that C(t,s) is in L 2 ([0,1] 2 ,M), it follows that 


^ EX 0 (t)X t (s) 


and 


Clearly, 


1=m +1 


—m —1 


—> 0, as m —> oo 


X] M 0 (f)I^) 


—> oo, as m —> oo. 


£X„(t)X<(s) - £X 0 , m (t)X <im (s) 

= £X 0 (f)X,(s) - £X 0 , m (f)X,( S ) + £X 0 , m (f)X,(s) - £X 0 , m (f)X,, m (s) 
and therefore by (12.41) and stationarity we conclude 

||£X 0 (t)X,(s) - EX 0 , m (t)X^ m (s)\\ < 2(X||Xo|| 2 X||X 0 - X 0 , m || 2 ) 1/2 . 


ffence 


X] (EX 0 {t)X e (s) - EX 0 , m (t)X e , m (s)) 

£=—m 


< 2(2 m + 1)(X||Xo|| 2 E||X 0 - X 0 , m || 2 ) 1/2 -)• 0, 
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as m —> oo, completing the proof of (14.7f) . Similar arguments give (14.811 . 

To prove (I4.9|l we first define 

ri, m = {K| > m,\j\ < m}, r 2i m = (K| < m, \j\ > m}, r 3)fn = {\£\ > m, \j\ > m} 

and 

r 4 ,m = (14 \j\ < m}. 

Let 


= EX 0 (t)X e}m (s)EX 0tm (t)X j (s)-a e (t, s), where a e (t,s) = EX 0 (t)X e (s ) 

For all l > 77i we have that EXo(t)Xe :7n (s) = 0 and therefore by the Cauchy-Schwarz 
inequality 


r l,m,l 


JJ E] aej tm (t, s)dtds = JJ E} ae(t, s)dj(t, s)dtd, 




< mixoW 2 X>n x o - x oA 2 ) 1/2 5>ii* 0 - x Qd 


|2U/2 


t>m 

—^ 0, as m —» oo, 


j =0 


where r 1)mjl = {£ > m, \j\ < m}. On the set r 1)rni2 = {£ < —m, \j\ < m} we write by the 
independence of X 0> £ and X^ m that 


E JJ \EX 0 (t)X e}Tn (s)EX 0}7n ( y t)X j (s)\dtds 

ri,m,2 ^ 

= E jj l^(Am(i)-^(i))^ I m(3)Mo, m (i)X J -(5)|did5 

Tl,m,2 J 

< E (^ll*o - ^o,_ £ || 2 ) 1/2 (£||Xo|| 2 ) 3/2 

ri,m, 2 

OO 

< (2m + 1)(£||X 0 || 2 ) 3/2 E(^ll X o - AVII 2 ) 172 . 

l=m 

It follows similarly that 

OO 

E \a e (t,s) aj (t,s)\dtds< (2m+l)(F;||Xo|| 2 ) 3/2 E( £; ll^o-Ao,,|| 2 ) 1/2 

r*l,m,2 

resulting in 


£=m 


Jj E aej,m(t,s)dtds 


—> 0, as m —> oo 


via (I2.4H . Similar arguments give for i = 2, 3,4 that 


Ol^ j rn(ti s)dtds 




—> 0, as m —> oo. 


12 

















Observing that 



OO 

ag(t, s)a,i(t, s)dtds — 

£,i=—o o 


lie'll 2 , 


the proof of (I4.9[) is complete. The proof of (14.101) goes along the lines of (14.9p . 


□ 


Lemma 4.3. If (12. ip (I2.8j) are satisfied, then we have 

lim limsup— E [[(Z N (t, s) — Z Nm [t, s)) 2 dtds = 0. 
m^oo n ^ oq h JJ 


(4.11) 


Also, for each m > 1 
N 


lim 

AT—Xx) h 


N 


var(Z/v(t, s))dtds = \\C\f + I / C(t,t)dt ) / K~(u)du, (4.12) 


2\ r l 


— / / var (Z NjTn (t, s))dtds = ( ||C m || 2 + ( / C m (t,t)dt 


-i 

2 \ /• 1 
'-1 


K'\u)du, (4.13) 


and 


lim ^ 

TV—>-oo h 


cov(Z N (t , s), s))dtds 


(4,14) 


// ^ £ £*o(*)**,m(s)J ^ ^ ^X 0jm (t)^( S )j 

f 00 \ " 'l /*! 

X] EX 0 (t)X e , m (t)dt [> / A' 2 (w)d«. 


£=—oo 

Proof. By a simple calculation 
N 


h 


E (Z N (t,s) - Z Nim (t,s)) dtds 


N 

~h 


N 

var(ZAr(t, s))dtds + — j f var(Z/v im (i, s))dtds 


-2^-JJ co v(Z N (t,s),Z NiTn (t,s))dtds, 

and hence (14. lip follows from Lemma [4721 and (I4.12p - (I4.14I) . 

We recall ag{t,s) = EX 0 (t)Xg(s) and let 

fpe,r, P (t,s ) = f;[I 0 (()I<(s)I r (t)I P (s)] 

— a,g{t, s)flp_ r (t, s) — a r (t , t)cip_^(s, s) — cip(t, s)a r -g(t, s). 

As the first step in the proof of (14.121) we show that 

. /i JV-l 


sE £ 


g,£=—h r=—(N— 1) 


A,r,r+g(t,s)dtds 


—> 0, as IV —» oo. 


(4.15) 
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It is easy to see that 


h N—l 

sE E 


1p^r,r+g(t, s)dtds 


g,l=—h r=—(N— 1) 

„ h h N -1 


(4.16) 


ZEE 

£=0 g =0 r =0 
„ h h 


1p£, r ,r+g(t, s)dtds 


+ ^EE E 

€=0 3=0 r =-(jV-l) 

-1 -1 -1 

+-+sEE E 


'lp£,r,r+g(t, s)dtds 


£=—h g=—h r=—(N— 1) 


lf)£ t r t r+g(t, s)dtds 


where the right hand side contains eight terms corresponding to the combinations of the 
indices £, g and r taking either nonnegative or negative values. Due to stationarity, we 
only consider the first term. In the summation of i/j^r^+g-, we consider three cases: i is 
less than r, i is between r and r + g, or £ is larger than r + g. 

Let R\ = {{£, g, r) : £ < r, 0 < £, g < h, 0 < r < N—l}, R 2 = {{£, g, r) : r < £ < r+g, 0 < 
£, g < h, 0 < r < N — 1}, and R 3 — {(£, g, r) : r + g < £, 0 < £, g < h, 0 < r < N — 1}. 
Clearly, 

h h N -1 

EEE 

£=0 g= 0 r=0 


'lp£,r,r-\-g(t■> S^jdtds 


< Ui : N + U 2 ,N + U 3: N, 


where 


U 1,N - Y 
Tii 


ip£, r ,r+g(t, s)dtds 


and 


U 3 ,n — Y 

Rs 

Using the definition of ^,r,r+s we write 


, U 2:N — Y 

R2 


ipe, r , r + g (t, s)dtds 


£>e,r,r+g{t, s)dtds 


E 

Ri 


sE 

Ri 


'll>t, r , r +g(t, s)dtds 

& r (t , s)dtds 

S^)CL r ^.g(t , s)dtds 


(4.17) 


E 

Ri 

E 

Ri 


[EX 0 (t)Xi(s)X r (t)X r+g (s) — ae(t, s)a g [t, s)\dtds 
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By the inequality (A.3) in Horvath and Rice (2014) and the fact that for any random 
variable ( E C 2 ) 1 ^ 2 < (At) 4 ) 1 / 4 we get that 


u r (f, s)dtds 


and 


s)o r -|-g(t, s)dtds 

where, we recall from (12.41) . 

ct= {EWXo-Xo^) 1 ' 4 ' 
Combining (14.18)) with the definition of R\ we conclude 

i s)dtds 


— ^ 11^011 ^r^r+g—t 

— ^ 11-^0 11 Cr-£Cr-\-g i 


E 

Ri 


Similarly, 


E 

Ri 


< E\\X 0 \\ 2 E CrC r -\.g—l 

Ri 

h N -1 h 

< E \\ X 0 \\ 2 E E c '-E Cr -\- g—l 


£=0 r =£+1 g =0 

oo oo \ oo 


<« EEHE' 


k £=0 r =£ / g =0 


& r —i(t , s^CL r +g(t) s)dtds 


<£||^ 0 || 2 E C,— iR-r+g 

Rl 

h N -1 h 

< BIIA'of C r _£C r+9 

£=0 g=0 

h N—l oo 

<£||X 0 || 2 EEE C r —£Cp 


£=0 r =£ p =£ 

oo oo \ oo 


E^- 

,£=o / r=0 


(4.18) 

(4.19) 


(4.20) 


(4.21) 


Let 1 < £ = £(iV) < h be a sequence of real numbers which will be defined below. We 
write R\ = Rii U where R,] t \ = {(£g,r) £ Ri : r — £ > £} and Ri 2 = {(£g,r) G 
i?i : r — t < £}. It follows from (A.9) of Horvath and Rice (2014) that there is a constant 
Ai, depending only on the distribution of Xq such that for all ( £,g,r ) G 


[EX 0 (t)Xi(s)X r (t)X r+g (s) — ae(t, s)a g (t, s)\dtds 


— Ax(c r _£ T Cr+g—^)- 


Thus we get that 



[EX 0 (t)Xi(s)X r (t)X r+g (s) — a<e(t, s)a g (t , s)]dtds 


(4.22) 
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h N h 

s-4.EE E (c r — £ C r -\-g —£) 

£=0 r=£+£ g=£—r 
oo 

< 2Aih 2 c p . 
p=C 

To obtain an upper bound when the summation is over R 42 we write i?i i2 = Uf =1 i?i )2i j 
where Ri i2 ,i = {(£,g,r) E R h2 ■ £ > £},Ri , 2 ,2 = {(£,g,r) E R 1j2 ■ g > £} and i2i i2j3 = 
{(£,g,r) E i?i j2 : £, g < £}. It follows from (A.4) in Horvath and Rice (2014) that there 
is a constant A 2 depending only on X 0 such that 


EXo {t)Xz(s)X r (t)X r+g (s)dtds 


< A ‘2 min(Q, c g ) for all ( £,g,r ) E R 4 . 


Thus we have 


Similarly, 



EX 0 (t)Xe(s)X r (t)X r+g (s)dtds 


h i+t, h. 

s 4 2 E E E 


Q 


i=i+l r=t g=£-r 


< MhzY^. 

i=i 


(4.23) 


E 

Hi,2.2 


EX 0 (t)Xe(s)X r (t)X r+g (s)dtds 


OO 

E A 2 h£ ^ 

e=z 


Cl- 


(4.24) 


It follows from the dehnitions of Ri t2 ,3 and JR i2 that Ri, 2,3 E {0 < £, g < £, 0 < r < 2£}, 
so we have with some constant A 3 that 


E 

Hi, 2,3 


EX 0 (t)Xi(s)X r (t)X r+g (s)dtds 

Similar but somewhat easier arguments show 

ae(t, s)a g (t , s)dtds 

with some constant A 4 . If (12.41) holds, then c % < 00 and 

/ 00 \ 

£w | Cj ) —> 0 , as £ —* 00 . 


<A 3 e 


E 

Hi 2 


E A 4 //,£ C( + 


(4.25) 


(4.26) 


(4.27) 
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Also w -1 ^) exists for small enough x (cf. Bingham et al (1987), pp. 28 and 29), and 
w~ 1 (x)/x 3 —y oo as x —> 0. Using theorem 1.5.12 of Bingham et al (1987) we get that 
(I4.27P is equivalent to 




Q —> 0, as i —* oo. 


(4.28) 


Therefore, with the choice of 




£ = 


w(l/h) 


in (I4.22p - (l4.26p we obtain that 

[EX 0 (t)X e (s)X r (t)X r+g (s) — s)a g (t, s)]dtds 


-Y 

h ^ 


Ri 


->■ 0. 


(4.29) 


Putting together (I4.20H . (14.211) and (14.291) we conclude 

1 


h 


Y 

Ri 


' l l>e., r , r + g (t, s)dtds 


-)• 0. 


(4.30) 


Similar arguments show that (14.301) remains true if the domain of summation R 3 is 
replaced with R 2 or R 3 and hence 


1 

h 



'fpe^r+git, s)dtds 


-)• 0. 


With minor modifications of the arguments above one can verify that the remaining 
seven terms in (14.16P also tend to 0, as N —* oo. 

Now we show that (14.151) implies (14.12H . By a simple calculation using (12. ip and (14.21) 
we get 


N cov( 7 ^(t, s),j g (t, s)) 

f min(N,N—t) mill (N,N—g) 

= * E E EX iW^x^x^s) 

v z=max(l,l —£) j'=max(l,l— g) 

— (N — \t\)(N- \g\)ae(t, s)a g (t, s) 1 

min(N,N—£) min(N,N—ff) , 

= jy yfttj-ij-i+git’ s ) 

i=max(l,l —€) j"=max(l,l— g) x 

T dj—i-\- g (t, S^dj—i—i(ti s) T dj—i(t, t)<3j_j-|_g l _^(s, s)^ • 

Notice that the summand in the last formula depends only on the difference j — i. Let 
(fN(r,£,g) denote the cardinality of the set {(i,j) : j — i = r, max(l, 1 — i) < i < 
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min(iV, N — £), max(l, 1 — g) < j < min (IV, IV — g)}, i.e. r(r,£,g) is the number of 
pairs of indices i , j in the sum so that j — i — r. Clearly, < p N (r,£,g) < N. Also, 
</?jv(a g) > N — 2{\£\ + |r| + |g|), since {(i, i + r) : max(|r|, 1 — £ + |r|, 1 — g + |r|) 
i < min (IV — \r\,N — g — |r|,IV — £ — |r|)} C {(i,j) : j — i — r, max(l, 1 — £) 
i min(IV, N — £), max(l, 1 — g) < j < min(IV, N — g)}. Using the notation 

<fN(,r , £, g) = tp N (r ., £, g)/N (4.31) 


we can write 

Ncov(7*(t,s),7s(M)) 

N -1 

^ ^ <Pn{Ti £i g ) {'^p£,r,r+g(j'i ®r+gr(C S^)d r —i{ti s) "h d r (t, t)o r _|_^_£(s, s)} • 

r=-(iV-l) 

It follows that 

^var(C , iV (t,s)) = ^ ^ K(g/h)K(£/h)cov(^(t,s),%(t,s)) 

g,£=-h 

= Qi,N(t, s ) + g 2 ,iv(c s) + q 3 ,iv(C s), 


where 


h N-l 


qi,N(t,s) = - E E K{g/h)K(£/h)(p N (r, £, g)il>t,r,r+ g {t, s ), 

' g,e=-hr=-(N-l) 

^ h N-l 

q-2,N(t,s) = - E E K{g/h)K{£/h)ip N {r, £, g)a r+g (t, s)a r - e (t, s), 

g,£=—h r=—(N— 1) 

^ h N-l 

q3,N(t,s) = - E E K{g/h)K{£/h)ip N {r, £, g)a r (t, t ) C1 r+g~e{ s j s )■ 

g,£=—h r=—(N— 1) 

We start with q 2 ,v- Let £ > 0. By a change of variables we have 


i>2 


?2,JV(M) = 

where 

and 

If 


h 


E E A 

\u\,\v\<h-\-N—l r=b\ 


h 


u — r \ / v — r 

K 


h 


<Pn(t, r — v,u — r)a u (t, s)a v (t, s ), 


b\ = b\(u, v, N ) = max(« — h, v — h, — (IV — 1)) 
&2 = 62 (w, v, N ) = min(w + h, v + h, N — 1). 


(4.32) 

(4.33) 


<?2 


(M) , - , 1 


b2 


>*) = 5 E E A 


M>|<M r=bi 


u — r \ ,1 v — r 


h 


K 


h 


(p N (r, r -v,u- r)a u (t, s)a v (t , s), 
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then we have 


I 0 . 2 ,n( tj S ) - q { 2 M N \t,s)\ 

1 b2 

4 E E 

u,v£0isr t M r=b i 


/I 


u — r 


K 


v — r 


<Pn(v, r — v,u — r)a u (t, s)a v {t , s ) 


where Qn,m = {u,v : |w|, |u| < h + iV — l,max(|w|, |u|) > M}. By assumption (12.61) . the 
number of terms in r such that b\(u,v,N ) < r < b 2 (u,v,N) and K((u — r)/h)K({y — 
r)/h) 7 ^ 0 cannot exceed 2 h for any u,v. Since |<^jv| < 1, we conclude 


m 


,jv(M) - q ( 2 M J(t,s )I < 2 sup Ii 2 (x) ^2 \ a u(t,s)a v (t,s)\. (4.34) 


M<i 


u,vGO n,m 


The Cauchy-Schwarz inequality yields 
| 92 ,k(*. s) - $$(t, s)\dtds 


(4.35) 


< 2 sup K 2 (x) 
l*l<i 


E 

\u\>M 


2 E 


E 


|u|>M 


< e/4, 


by taking M sufficiently large. We recall that N — 2(r + £ + g) < ip(r,£,g) < N. If 
|w|, |v| < M, bi(u, v, N) < r < b 2 (u, v, N ) hold, then |r| < M + h and hence for such u, v 
and r we also have \(p(r,r—v,u—r)—N\ < 2|r+r— v+u—r\ < 2(|r| + |u| + |u|) < 2(h+3M), 
resulting in that \<fiN(r, r — v,u — r) — 1| < 2(3 M + h)/N. Using (12.81) . one can establish 
along the lines of the proof of (14.351) 


b2 




\u\,\v\<M r=b\ 


u — r 


K 


v — r 




dtds (4.36) 


< e/4 


for all large enough N. By (12.71) and (12. 8 |) . for any rj > 0 we have 

- K 2 


sup sup 

\u\,\v\<M r 


h 


K u-r L ^K IV - r 


h 


< V: 


when N is sufficiently large. Since we can take rj > 0 as small as we wish, it holds for 
all large enough N that 


&2 


5 E E 

\u\,\v\<M r=bi 

< e/4 


K 


u — r 


K 


v — r 


K 1 h 


Quit) S^Ct v (^t, s) 


dtds (4.37) 


Clearly, according to the definition of a Riemann integral 


sup 

|u|, | v| <JVf 


b2(u,v,N) 


h 




K 2 {z)dz 


r=b\ ( u,v,N ) 


—» 0, as N —> 00 . 
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Using the definition of C(t, s ) one can easily see via the Lebesgue dominated convergence 
theorem that 


a u (t, s)a v (t, s)dtds 

M,M<m 


a u (t,s ) 1 dfds —>■ ||C||" 

H<M 


as M —» oo. Thus we get that for all IV and M sufficiently large 

-r If ^ (0 a u (t,s)a v (t,s)dtds - ||C|| 2 f K 2 (z)dz 

\u\,\v\<M r=bi 

Combining (I4.34p ~ fl4.38p we conclude 


lim 

iV—>oo 


Q 2 ,N(t, s)dtds = \\C\\ 2 / K 2 (z)dz. 


i-i 


Observing that 


< e/4. (4.38) 


(4.39) 


a u (t,t)a v (s, s)dtds = / a u (t,t)dt 

\u\,\v\<M W |u|<M 


->■ 


as M —> oo, minor modifications of the proof of (14.39P yield 

2 .1 


^irn j I q 3i jsr(t, s)dtds = ( / C(t,t)dt 


C(t, t)dt ) , 


K 2 (z)dz. 


(4.40) 


i-i 


Finally, by fl445l) 

qi,N(t , s)dtds 


h N-l 

- T> SU P K S 

g/=—h r=—(N—l) 


h |x|<c 


^r.r+git, s)dtds 


->• 0, (4.41) 


as IV —> oo. The result in f!4.12p now follows from fl4.39p - fl4.4ip . 
Clearly, (I4.13P is a special case of fl4.12l) . 

Let 


s) = UX 0 (t)X £ (s)X r ., m (t)X Pim (s) - a e (t, s)a p - rjm (t, s ) 


S ) - s)a>r-l,m(t, s), 


(2) (+ 


where 


ae, m (t,s ) = FA r o, m X<,m(s),4^(M) = ^o,m(^)^(s) and a^(f, s) = LI 0 (^Yf, m (s). 
Under the conditions of the Theorem 12.11 we have that 


h N -1 

sE L 


g/=—h r=—(N— 1) 




—* 0, as N ^ oo, (4.42) 
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along the lines of (14.1511 . It follows from the dehnitions of and Z^ :Tn that 

h h 


N ~ ~ N ^ 

—EZ N (t, s)Z N>m (t, s) = — 2J z2 K 

£=—hk=—h 


h 


I< 


cov (7 e{t,s),% tTn {t,s)). 


Also, 


Ncov(je(t, s),jg im (t, s)) 

{ min(N,N—t) min(A r ,7V— g) 

E E 

z=max(l,l— i) j=max(l,l— g) 


+ afl i+g m (t, s)a^_ £ m (t, s) + t)ci^ i+g _ £ (s, s ) E 


,(!) 


( 2 ) 


,( 2 ) 


Following the proof of (14.411) one can show that (14.421) implies 


h h min(iV,iV— i) min(W,A r — g) 


EE E E K ( h I K ( h ) Wj-U-i+gfo s ^ dtds 


h 


,W 


i=—h k=—h z=max(l,l —£) j=max(l,l— g) 

as N —* oo. Along the lines of (I4.39j) and (14.401) we get that 

h h min(N,N—£) min(A r ,JV— g) 


0, 


h 


EE E E * 

i——h k=—h z=max(l,l —£) j=max(l,l—g) 


h j K (l 


afl i+gtm (t, s)a^ i _ £ m (t, s)dtds 


(i) 


—y 


ff (E EXo^X^s^j EXo^Xjis)^ 


and 


h h min(N,N—l) min(N,N—g) 


AE E E 


£——h k=—h z=max(l,l —£) j=max.(l,l—g) 


h 


t)ay_! i+g _ e (s, s)dtds 


dtds J K 2 (u)du 


d 2 ) 




E EX 0 (t)Xe jfn (t)dt 

£=—oo 

completing the proof of (14.14H . 


K 2 (u)du, 


1 


□ 


4-2. Approximations with finite dimensional processes 
Based on the result in Section 14.11 we now assume that 

Xi(t), —oo < i < oo is an m-dependent stationary sequence, (4.43) 

EXi(t) = 0 and A||X 0 || 4 < oo. (4.44) 

First we replace the bivariate cumulant function 'ipe. r .p of Section l4dl with the four variate 
version 

~X.i,r,p(t , s, t , s ) A[Ao(t)-A^(s) X r (t ) Xp ( s )] Uf(t, s^)a p — r (t , s ) n r (t, t )cip_^(s, s ) 

- a p (t,s')a r _e(s,t'). 
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Lemma 4.4. If (14.43p and (I4.44p are satisfied, then we have 


OO 

^ ^ X£,r,p(fi s i t , S ) 
£,r,p=—oo 


< OO. 


Proof. Using stationarity arguments, we need to prove only that 


OO 

^ ^ Xi,r,p(fi $1 t , S ) 
£,r,p=0 


< OO. 


Let D = {(£, r,p) : l,r,p > 0} and Lfi = {( £,r,p ) : 0 < i < r < p). If ( I,r,p ) G D { and 
p — r > m, then X£,r,p — 0 since each term in the definition of Xt,r,p equals 0 in this case 
due to the m-dependence. Similarly, if I > m or r — I > m, then Xi,r,p equals 0 for all 
(£,r,p) G D\. Therefore {{£, r,p) G Lfi : Xe,r, P 0} C {(£, r,p) : 0 < £ < m, 0 < r < 
2m ,p — r < m} and the last set has no more than 6(m + l) 3 elements. Hence 


'y ^ Xi,r,p(fi S, t , S ) 

£>i 


< OO 


(4.45) 


since only finitely many terms are different from zero in the sum. The other subsets of 
D can be handled similarly so the details are omitted. □ 


Let 

L N (t,s,t!,s , ) = Y Y A g^'S'))- 

n e,g=-h ' 1 ' ' 1 ' 

Lemma 4.5. If (I4.43P and (14.44p are satisfied, then we have that 

II Ln — L\\ 0. 


where L is defined in (12.101) . 

Proof. Following the proof of Lemma 14.31 we write 

L N (t, s, t', s') = q liN (t, s, t!, s') + q 2 ,N(t, s, if, s') + q 3iN (t, s , if, s'), 

where 


^ h N —1 / ^ \ / \ 

qi,N(t,S,t',s') = - Y Y K (fi) K [fiJPN(r,£,g)Xe,r,r+g(t,S,t',s'), 

n g/=-hr=-(N- 1 ) ' ' ' ' 

^ h N—l / f \ ( \ 

q2,N(t,s,t',s') = - Y Y K ( T) K \r)PN(r,£,g)a r+g (t,s')a r - £ (t',s), 

n P — — h \ n / \ H / 


g,l=—h r=—(N— 1 ) 
h. N -1 


n — i / £\ / \ 

q 3 , N (t,s,t',s') = - Y Y K yfij K yfijPN(r,£,g)a r (t,t')a r+g _ e (s,s'), 


g,£=—h r=—(N— 1 ) 
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and ifiN(r,£,g) is defined an (14.311) . If we write 


L[t, s, t', s') = L^\t, s, t', s') + L^ 2 \t, s, t', s'), 


where 


and 


L^\t, s, t', s') = C(t, s)C(t', s') 
L^ 2 \t,s,t',s') = C(t,t')C(s,s') 



K 2 (z)dz 


K 2 {z)dz, 


J —C 

then by the triangle inequality we get 

\\L n ~ L\\ < lki,jv Il + lk 2 .»-i (1) ll + lk3,iv-i <2) ||. 


Clearly, 


lki,iv|| < 7 sup K 2 (x) 


h 


\x\<c 


oo 

X£,r,q 

£,r,q=—oo 


—> 0, as N —> oo, 


on account of Lemma 14.41 By assumption (12.8p for all large enough N we have that 
h + IV — 1 >7Ti. Since aj = 0 for all | j \ > m, by a change of variables we have for all 
large enough N 


q2,N(t,s,t',s') 


l E t«(- h 

\u\,\v\<h+N r=bi ' 


K 


v — r 
h 


Vn{t, r — v,u — r)a u (t, s')a v (t', s) 


1 

h 
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E J2 k 

\u\,\v\<m r=bi 



K 



<Pn(t, r — v,u — r)a u (t, s')a v (t', s), 


where b\ = b\(u,v,N) and b 2 = b 2 (u,v,N) are defined in (14.321) and (14.331) . respectively. 
Define 


&2 


q2,N,l(t,S,t',s') = - Y 


M,|u|<m r=b 1 

b2 


U — r 


h 


I< 


v — r 


h 




Q2,N,2(t, S, t', .S') = - Y I{2 (jj s ') a V (t', «), 

M,|u|<m r=b\ 

1 h r 

q2,N,3(t, S, t', .S') = - Y Y K2 (~h) 


|u|,|u|<m r=—h 

Since \(p^(r,r — v,u — r) — 1| < 2(3 m + h)/N for all 1 < r < N and |n|, |n| < m we 
conclude by Fubini’s theorem that as N —» 00 , 


2Q(3m + h) 

Li |a;|<i 


II 92 ,N ~ q2,N,l\\ < “' q6K ”"“ ' SUp K 2 (x) -> 0, 
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where 


q = [ ff (i«u(<,«')i] dtds> [[(^2 m ^)!) dt> 


2 x 1/2 

ds 


Using (12.71) one can find a constant rj such that 


and therefore 


sup 

M>M<m 


K 


sup 

|u|<m 


u — r 


I< 


u — r 


h 


K 


h 


v — r 


-K 


h 


< T) 


m 


h 


(4.46) 




m 


< 2 / 7 — sup \K(x)\. (4.47) 

h p|<i 


By il 1. Kill and (I4.47P we obtain that 


777/ 

||<? 2 ,iv,i - g 2 ,jv, 2 || < 277(5— sup \K(x)\ ->• 0, as iV->oo. 

h p|<i 

It follows from the definitions of b\ = bi(u , v, N ) and b 2 = b 2 (u, v, N ) in (14.321) and (14.331) 
that 

2 Qtti 

\\q2,N,2-q2,N,3\\<—[—SUpK 2 (x) -»• 0, as TV ->• OO. 

h |x|<i 


Finally, 


||?2,at,3 — U (1) || < Q 


r=—h ' /_1 


—)■ 0 , 


as iV —> oo, since K is Riemann integrable. This also concludes the proof of 

II92 ,n - L [l) || —y 0, as N —> oo. 

Similar arguments yield 

||?3 ,jv - U (2) || — y 0, as N — > oo, 

completing the proof of Lemma 14.51 □ 

Let 0j(£), 1 < i < oo be an orthonormal basis of L 2 ([0,1],R). By the Karhunen-Loeve 
expansion we can write 

OO 

m) = E<- Y - 


i=i 


Define 




e=i 
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and correspondingly zffl = s ) — ECff’fb, s), where 


(d), 


Cn ’(*, s)= ^K(-) 7i(t, s) 


with 


7 ^(M) = %N(t,s) = < 


JV-i 




J=1 

AT 


E v^wySSw, * < o. 


N 


j=l~i 


i > 0 


It follows from the Karhunen-Loeve theorem that 

E\\X 0 -X^\\ 2 -> 0, asd^oo. 

Let 

m 

c w {t,s)= J2 EX (d \t)EXf\s). 

£=—m 

Lemma 4.6. If (14.4311 and (11.11 1) are satisfied, then we have that 

lim limsup — E\\Zn — Zff || 2 = 0. 

d-too N->oo h 

Also, for each d > 1, 

^lim — f f var (Z^\t, s))dtds = ( || < 17 ^ || 2 + ^ f (t,t)dt 


(4.48) 


(4.49) 


K'\u)du , (4.50) 


and 



Proof. Using the Cauchy-Schwarz inequality and stationarity we have 


(4.51) 


E[(X 0 (t) - X^(t))Ah( S )]UXo(t)X,( S ) 


dtds 


(4.52) 


< 


[E(X 0 (t) - X^^X^fdtds 


1/2 


[EXoitfEXj^fdtds 


1/2 
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< 


E{X 0 {t) - X^ d \t)) 2 EX 2 (s)dtds 
= (E\\X 0 - X^\\ 2 ) 1/2 (E\\X 0 \\ 2 ) 3/2 
and similarly 


1/2 


EX 2 (t)EX 2 (s)dtds 


1/2 


E[X^(t)(X,(s) - y 0 '( S ))]SX™(i)y a '(s 

< {E\\X 0 - X^ ) || 2 ) 1/2 (£||X^ ) || 2 ) 3/2 

< (-S||X 0 — Xg d) || 2 ) 1/2 (S||Xo|| 2 ) 3/2 . 


(< 0 / 


<d). 


d d )i 


dtds 


Hence by elementary calculations we conclude from these inequalities 

EXoWXi^EXoWXjis) - EXW{t)xW{s)EXW{t)xW{s) 
< A(E\\x 0 - xW|| 2 ) 1/2 (£;||x 0 || 2 ) 3/2 . 

with some constant A. Thus we get as d —> oo that 

m m 

EX^(t)EXf(s) Y. EX 0 (t)EX,(s) 


(4.53) 


dtds 


£=—m 


m r, m 

Y EX^ d) {t)EX {d \t)dt Y EX 0 {t)EX t (t)dt 

n _ ™ 'J n _ ™ 


(4.54) 


(4.55) 


and 



^ EX 0 {t)xf\t)dt 




Y EX 0 (t)EX e (t)dt. 


(4.56) 


(4.57) 


On account of (14.481) . the result in (j4.49j) follows from (14.121) . (14.50H . (I4.5ip and (14.541) - 

dMZD. 

Lemma [4.51 implies (I4.50jl . The proof of (14.511) goes along the lines of (j4. 14[) but it is 
much simpler since (14.151) always satisfied for m-dependent random functions. Hence 
the details are omitted. □ 
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4-3. Normal approximation in case of finite dimensional m-dependent processes 
Based on the result in Sections 14.11 and 14.21 we can and will assume in this section that 


Xfit), — oo < i < oo is an m-dependent d-dimensional stationary sequence, (4.58) 


x,(t) = J 2 (Xi 

t= i 

where fifit), i > 1 is a basis of L 2 . Let 


c* N (t,s) 


oo / ■ \ 

E- ^*(m) 

= — no ' 


(4.59) 


with for all —N < i < N 


7 ,*(<,»)= 

3 = 1 

First we show that the difference between Z* N {t, s) = C* N (t , s) - EC* N (t, s) and s) 

is small. 


Lemma 4.7. If (IT58D . (IZ5ll - (lE8l) are satisfied, then we have 


Proof. Let 


N 

P 


&LN ~ 


— Z N | 2 = op(l), as 

N —* oo. 

{j: N — I < j < N}, 

if I> 0 

{j : 1 < j < 1 - 

if I < 0. 


Then according to the definitions of and Zfj we have 


E\\Z N - Z* N \\ 2 = 


N 2 


OO oo 


E E K 


l=—oo P=—OO 


h 


K 


(4.60) 


* E E ( EXfit)X j+ fis)Xfit)X i+p (s) - a fit, s)a p (t, s ) j dtds. 


jGse t N *Ss Pi jv 


Using the m-dependence of the AYs, one can verify along the lines of the arguments 
used in Lemma [4.31 that the right side of (I4.60P is 0(h 2 ). Thus the result follows from 
(12.8j) via Markov’s inequality. □ 

Using (I4.59P we have 


Z' N (t,s) = £ K (£) (flit, s) - E 7 ;(t,s)) 
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d d ( h N 

= EE vEE« r,jCp,j+£ Etrjtpj+l)K(£/h) 

r =1 p= 1 L £=—h j= 1 


(j) r (t)0p(s), 


where 

= (Ay, 0r)- 

In order to show that (N/h)^ 2 Z^ (t, s ) can be approximated with a Gaussian process, 
we begin by establishing that the d 2 -dimensional vector 




h N 


(ppEEK r,j£p,j+£ E{, r ,j£,pj+e)K(l/h), l <r,p < dj ^ jV d 2 , (4.61) 

where Ais a d 2 -dimensional normal random vector. By the Cramer-Wold device it is 
sufficient to show that 


d d 


h N 


EE&* 


*' p (NhW 2 

r= 1 p= 1 ' ' l=—h j =1 


EE« r,j£p,j+e EtrjZ P j+e)K(e/h)”tf, (4.62) 


for any constants (3 rtP , 1 < r,p < d, where A f denotes a normal random variable. By the 
definition of Gy, 

£r,j£p,j+i II Xj (t) Xjj^Q (s)</y(t)0p(s)dtcis, 


and therefore 

d d 


h N 


EE a* 

r=l p=l 


(N/i) 1 / 2 


^ 1 ^ ] (£r,j£p,j+l E£r,j£p,j+e)K(£/h) 


l=-h j=l 
h 


(Nh ) 1 / 2 


£=-/i 


E*(s)E 


JV 


i=i 




d d 


-EXjW w»))EE /3r,p4>r{t)4>p{s) fdtds. 

r= 1 p=l 


Therefore (j4.62[) follows if we prove that for any / G L 2 ([0, l] 2 ,’ 

E^(|)E“,Av. 


(Wr)V2 




(4.63) 


j=i 


where 

= JJ (Xj(t)X j+ i(s) - EXj(t)X j+i (s))f(t,s)dtds. 

The proof of (I4.63|> is based on a blocking argument. We write 


h N 

A N = ^^2 <Xj,tK 


i=-h j =i 


Q Q 

= ^2 ^ A Di + T\ 
2—1 2—1 
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where 


j&Bi t=—h 


Ri = E E a i.‘ K ( i) - D - = E E <v< A ' 


j£bi i=—h 


h 


and T' = EE Oij/K 

jcT e=-h 


h 


with 


B, L — {j : 1 + (i — 1 )M + 2{i — l)h < j < 1 + iM + 2{i — 1 )h} , Q = |_A/(2h + M )J 
= {j : 1 + iM + 2(i — l)h < j < 1 + i(M + 2 h)} , T = {j : Q(2h + M ) < j < N} 

and M > h is a numerical sequence. It follows from assumption (14.58ft that R\, R 2 , ■.., 
are independent and identically distributed random variables with zero mean. Similarly, 
Di, D 2 ,..., Dq are independent and identically distributed random variables with zero 
mean. 


The following elementary lemma will be useful to get sharp upper bounds for the mo¬ 
ments of the blocks. 

Lemma 4.8. Suppose {Yi\ c fL 1 is an m-dependent sequence of random variables. Then 
for all £ > 0, the sequence of random vectors {(Y), Y l+k )}™ 1 can be organized into at most 
3(m + l) 2 collections each containing independent random vectors. 

Proof. The sequence {(Y), Y i+f )} ( fL 1 is rri + ^-dependent, it can be organized into m + £ + 1 
subsets, each containing independent random variables using standard arguments (see, 
for example, Lemma 2.4 of Berkes et al (2012)). Hence the result is proven for £ < 2m+l. 
From now on we assume that l > 2m + 1. Let j* = max{j : j < {£ — m)/(m + 1)}, 
k* = minjfc : k > (m + £)/((m + l)j*)}, and v* = ((k* + 1 )j* + l)(m + 1). Dehne the set 


Gi,k\P ) ^ {Yp V *+(kj*+j)(m+l)+ii ^ pv*+(kj*+j)(m+l)+i+l) j 0 — j E j 


for l<i<m + l, 0<k<k* and 0 < p < oo. Consider two arbitrary elements of 
Gyfc(p), X r and X^ , 

Ypv*+(kj*+t)(m+i)+i+e), where, without loss of generality, 0 < r < t < j*. Clearly, 
kpu*-t-(fcj*+T-)(m+i)+i ^ independent of and since 

r t. Also, Y pv *+(kj *+r)( m +1 )+i+e) is independent of Y pv * + ^ kj * +t ^ m+ r) +i+i ) due to r < t. 
Using the dehnition of j*, we have 

| pv* + ( kj * + r)(m + 1) + i + £ — (pv* + ( kj* + t)(m + 1) + i)| = \£ — (r — t)(m + 1)| 

> £ — j*(m + 1) > m. 


Hence Y pv * +(kj * +r){m+1)+i+e and Y pv * +{kj * +t){rn+ \ )+l are independent, establishing the in¬ 
dependence of X r and X ( . It follows along these lines that the vectors in G itk (p) are 
mutually independent. Due to the definition of j*, Gi tk (p) is comprised of j* + 1 inde¬ 
pendent random variables. Further, according to the dehnition of v*, Gi )k (p) and Gi^(p') 
are independent for all integers p ^ p'. By the definitions of k* and j* we have that 


k* < 


m + £ 

(m + 1 )j* ~ 


m + £ 

£ - 2 m - 1 


< 3m + 2, 


where we used 


.?* > 


£ — m 

m + 1 
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It follows that the union of the at most (3m + 3)(m + 1) sets (p ), 1 < i < 

m + 1, 0 < k < k* contains {( Y iy Y l+ /)}fiL v 

□ 


Lemma 4.9. If (14.58j) . (12.511 - (12.71) are satisfied, h = h(N ) —> oo and M/h —» oo, then 
we have 


E((hM)- 1/2 i?!) 2 -)■ 


L(t , s, t ', s')f(t, s)f(ts')dtdsdt'ds' (4.64) 


where L is defined in (12.101) , 


E |i?i| 2+,5/2 = 0(h 2+s/2 M 1+s/4 ) 


(4.65) 


and 

ED\ = 0(h 2 ). (4.66) 

Proof. The assertions in (I4.64D and (I4.66p can be established along the lines of the proof 
Lemma [4.51 Due to the m-dependence assumed in (14.581) . the proofs are much simpler 
in the present case. 

By Petrov (1995, p. 58) 


E \ Ri \ 2+s/2 < (2h + 1) : 1+5/2 t 2 + 5/2 

l=-h 



Using Lemma [4.81 we can write as the sum of no more than 

each sum is based on i.i.d. random variables. Hence via the triangle 
inequalities we get 

/ /M+l \ '/(2-H/2) 

“’■> - c » M ' /2 


i=l 


3(m + l) 2 sums, 
and Rosenthal’s 


with some constant cq, completing the proof of (14.651) . 


□ 


Lemma 4.10. If (14.581) and (l2.5MI2.9j) are satisfied, then we have (lVh) -1//2 Ajv con¬ 
verges in distribution to a normal random variable with zero mean and variance 
f- ■ -f L{t , s, t', s') f{t, s)f{t', s')dtdsdt'ds'. 


Proof. Under assumption (12.9ft one can hnd a sequence M such that M/h —> oo and 
/r(M/iV) 5 /l 4+5 ^ —> 0 and therefore using (I4.66P of Lemma, 14.91 and the independence of 
the D/s we obtain that 


E 




= o(l) 


and therefore 


Q 


VNhjr( 




4 o. 
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Similar argument yields 


1 


VWh 

Using now (14.641) and (14.651) we conclude 

l/(2+5/2) 


r -4 0 . 


Eh E \Ri \ 2+5/2 


E?„ 


1/2 


= 0 ( 1 ) 


(Q/r 2+<5/2 M 1+<5/4 ) 1/(2+ ' 5 / 2 ) 
(hQM) 1 / 2 


^ ^/V 1//(2+<5 / 2) /iM <5 /( 8+2<5 ) 


(7V/i)V2 

Now Lyapunov’s theorem (cf. Petrov (1995, p. 126) and (14.641) imply Lemma [4.101 □ 


Lemma 4.11. If (I4.58[) . (I2.5D - (12.91) and are satisfied, then we can define Gaussian pro¬ 
cesses Ttv(£, s) with ET a r(t, s ) = 0, ATAr(f, s)r N(t', s') = L(t , s, f', s') such that 

\\{N/h) l ' 2 Z* N - Ttv|| = Op(l), as N ^ oo. 


Proof. As we argued at the beginning of this section, Lemma 14.101 yields that (14.611) 
holds with J\f d 2 = {J\fd?fr,p), 1 < r,p < d}, EJ\f d 2 (r,p ) = 0 and 


EJ\f d 2 (r,p)J\f d 2 (r',p') = L{t , s, t', s'](j) r (t)(j)p(s)(j) r fit')(j) p '(s')dtdsdt'ds'. 



By the Skorokhod-Dudley-Wichura representation (cf. Shorack and Wcllner (1986), p. 
47) we can define A = {A f^\r,p), 1 < r,p < d, a copy of Af ( p such that 


max 

l<r,p<d 


Clearly, 


h N 


(Nh)- 1 ' 2 J2 - ECP P , j+l )K(e/h) - A/ ( f V, p) 

l=-h j =1 


= op(l). (4.67) 


cf d 


,p)(j) r (t)(j) p (s) 

r= 1 p=l 

is a Gaussian process with mean zero and LTAr(f, s)rAr(t', s') = L(t , s, f', s'). Using now 
(14.671) . Lemma 14.111 follows. □ 


Next we show if (j2.12[) is satisfied then the conclusion of Lemma 14.111 holds assuming 
only (12. 8p instead of the much stronger restriction (j2.9[) on h. 


Lemma 4.12. If (I4.58p . (l2.5l) - (l2.8p and (12.12p are satisfied, then we can define Gaussian 
processes T N (t, s) with ET N {t , s) = 0, ET N (t, s)T N (t', s') = L(t , s, t', s') such that 


\\(N/hy/ 2 Z* N - r w || = 0 p(l), as N —> oo. 
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Proof. Following the proof of Lemma (14.51) we can verify that 


ER{ = 0(h 2 M 2 ). (4.68) 

In the proof of Lemma 14.101 when Lyapunov’s condition is verified we now use (14.681) 
instead of (14.651) . Hence Lemma [4. 101 holds assuming only (12.81) when (12.121) holds. Now 
Lemma f4 .12 1 follows from the central limit theorem of Lemma 14.101 using the Skorokhod- 
Dudley-Wichura representation theorem (cf. Shorack and Wcllncr (1986), p. 47) as in 
Lemma 14.111 □ 

4 . 4 . Proofs of Theorems \2. iffiO 

Proof of Theorem \2.1i Using the results in Sections 14.11 and 14.21 with Lemma 14.111 for 
every £ > 0 there are integers mo and do such that 

limsup P { \\(N/h) 1 / 2 Zn — r 7 v,rf,rr!.|| > s} < £ for all m > mo,d > do, 

N —>00 


where 


d d 


{T N ,d,m{t,s),0 < t, s < 1} = < y, y, (r, p) (fr jt)(j)p (s) , 0 < t, s < 1 > , 


. r= 1 p= 1 
d d 


r = y y yr ) (r,p)0 f (t)0p(s), 

r =1 p= 1 

is an orthonormal basis of L 2 , and {A fjf l \r,p), 1 < r, p < d} is d 2 -dimensional 
normal with zero mean and 


EAfj 2 m) (r, p)A/)p n) (r', p') = [■■■ L (m) ( t, s, t', s')<p r (t)4> p {s)^ r '{t')<f> P '(s')dtdsdt'ds' 


with 

L^\t,s,t4s') = [C m (t,s)C rn (t4s') + CUtd')C r n(s,s')} J K 2 (z)dz, 

m 

^ ^ COv(-Xg jm (t), -^Q,ra(^)) 5 

£=—m 

and the variables are defined in (12.41) . Using (I4.7j) we conclude ||— L\\ —> 0, as 
m oo and therefore 

{Af^\r,p),l < r,p<d} {M{r,p), 1 < r ,p < d}, as m —* oo, 
where {M{r,p), 1 < r, p < cx)} is Gaussian with zero mean and 


EJ\f{r, p)J\f{r', p) 


L{t, s, t', s , )0 r (t)0p(s)0 r /(t , )0p/(s , )dtdsd^ , ds^ 
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Hence we can define Gaussian processes T^ m) (t,s) such that ||r rfim — T ( f n} } = op(l), 
{r^ m) (f, s), 0 < t, s < 1 } = {T^t, s), 0 < t, s < 1 } and 

d d 

U(M) = EE N(r,p)Mt)M s )- 

r =1 p= 1 

Observing that ||r rf —r|| = o P ( 1) as d ^ oo, where T(t, s) = Y^iY^iN(r,p)<j> t (t)<j> p (s), 
the proof of Theorem 12.11 is complete. □ 

Proof of Theorem \2.2i We can repeat the proof of Theorem 12.11 we only need to replace 
Lemma 14.111 with Lemma 14.121 □ 

Proof of Theorem \2.3i . ft is easy to see that 

EC N (t,s ) = K 7 e (t,s) - jh k(t) he(t,s) 

i=-oo ' ' v e=-oo ' ' 


and 


Let e > 0. Next we write 



0 ( 1 ). 


E K 


£=—oo 



oo 

Y Te(t, s) + f N ,3 ) + /jV,2, £ (U s ) - f N}3 ,e(t, s), 

£=—oo 


where 

fN,l,e(t’ S ) = Y ( K (t) ~ fN,2,e(t> 8 ) = Y K (T) 7*(*, *) 

\t\<eh ' ' ' ' \t\ >£ h ' ' 

and _ 

fN, 3, £ (M) = Y 'tt(M)- 

\t\ >eh 

Using assumption (I2.14jl we conclude by the triangle inequality 


||/W,2, £ (M)|| < sup \K(u)\ Y INI < (he) q 'sup|A'(V)| Y I^INI 

U \£\ >eh U £=—oo 

and similarly 

oo 

iiwm)ii < (te) - ’' E w'ini- 

i =—oo 

By (12.131) we obtain that 

lim lim sup max | (.K (£/h) — l)/( \£\ //r) q — &| =0 

£—>0 h^oo —£h<i<eh 

and therefore 

lim lim sup ||h q /Ar,i, e - $\\ = 0. 

h->oo 

Since q' > q and 1P/N — y 0, the proof of Theorem 12.31 is complete. □ 
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4■ 5. Proof of Theorem I3.il 

Following the arguments used in the proof of Proposition 1 of Kokoszka and Reimherr 
(2013) one can show that 


max || (N/h) 1/2 (s e v e - v t ) - Qi,n\\ = M 1), 

l<£<p 


(4.69) 


where 


gln — y] 


k+l 


Vk(t) 

Xe — X k 


Zf[(u, s)vi(u)vk(s)duds 


and 


Z* N (u, s ) = (N/h)V 2 {C N {u, s ) - C(u, s)). 

By Theorems 12.11 and 12.31 we have 

max \\Z* n -(T n + 03911 = °p (!)■ 

l<t<p 

Let 9JI/; be the mapping from L 2 [0, l] 2 —> L 2 [ 0,1] defined by 

f(u , s)vi(u)vk(s)duds. 

The linear operators 9JR, 1 < d < p are bounded since 

ll^(/)H 2 = “ Afc )~ 2 (^1 f f(u,s)v £ {s)v k (u)dsdu^j 

where 


(4.70) 


k+l 


Vk(t) 

A e ~ A k 


k^£ 


< 


a £ 


Oil = 


Ai — A 2 , if t — 1 

min{A^_i - X £ , X £ - A £+ i}, if 2 < l < p. 

The operators SDfy, 1 < l < p are linear and bounded and therefore they are continuous 
(cf. Debnath and Mikusinski (1999, p. 27)). Hence (I4.69P and (14.701) imply that 


max || (N/h) 1/2 (s e ve - vf) - Q l N || = o P (l) 

1<£<P 


where 


^ Vk ^ 
g,At) - X yry 

k^l 1 K 


(Tjv(w, s) + o3(w, s))vi(u)vk(s)duds. 


Similar but somewhat simpler arguments give 


where 


max | (N/h) 1/2 X e - X £ - g £:N \ = o P (l), 

i<i<p 


Qc,n = (r N (t, s ) + a$(t, s))vi(t)vi(s)dtds. 
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Since vg(t)vk(s) is a basis in L 2 ([0, l] 2 , M), by the Karhunen-Loeve expansion we have 
for each N 


{T N {t,s),0 <t,s< 1} = 


^ OiJMi jVi (t)Vj (s), 0 < t, s < 

l<i,j<oo 



(4.71) 


where 


XjXj J K 2 (z)dz, if i 7 ^ j, 



The representation of the limit in Theorem 13.11 follows from (14.711) and the definitions of 
at and Gi, N (t)- 
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